Papers with multimodal query of image and question
MuKA: Multimodal Knowledge Augmented Visual Information-Seeking (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for visual information-seeking tasks rely on textual knowledge . existing methods can impair information retrieval and confuse MLLMs . |
| Approach: | They propose a framework which leverages a multimodal knowledge base to address these limitations. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on the InfoSeek and E-VQA benchmarks. |